Scientific data exchange: a schema for HDF5-based storage of raw and analyzed data.
نویسندگان
چکیده
Data Exchange is a simple data model designed to interface, or `exchange', data among different instruments, and to enable sharing of data analysis tools. Data Exchange focuses on technique rather than instrument descriptions, and on provenance tracking of analysis steps and results. In this paper the successful application of the Data Exchange model to a variety of X-ray techniques, including tomography, fluorescence spectroscopy, fluorescence tomography and photon correlation spectroscopy, is described.
منابع مشابه
The Impact of the Data Archiving File Format on Scientific Computing and Performance of Image Processing Algorithms in MATLAB Using Large HDF5 and XML Multimodal and Hyperspectral Data Sets
Scientists require the ability to effortlessly share and process data collected and stored on a variety of computer platforms in specialized data storage formats. Experiments often generate large amounts of raw and corrected data and metadata, which describes and characterizes the raw data. Scientific teams and groups develop many formats and tools for internal use for specialized users with pa...
متن کاملThe NeXus data format
NeXus is an effort by an international group of scientists to define a common data exchange and archival format for neutron, X-ray and muon experiments. NeXus is built on top of the scientific data format HDF5 and adds domain-specific rules for organizing data within HDF5 files, in addition to a dictionary of well defined domain-specific field names. The NeXus data format has two purposes. Firs...
متن کاملA parametric prototype for spatiotemporal databases
ly, an HDF5 File is a container for an organized collection of objects. The objects are Groups and Datasets and other objects. The objects are organized as a rooted, directed graph. Every HDF5 file has at least one object, the root Group. All objects are members of the root Group or descendents of the root Group. HDF5 objects have a unique identity within a single HDF5 file, and can be accessed...
متن کاملPhoton-HDF5: an open file format for single-molecule fluorescence experiments using photon-counting detectors
We introduce Photon-HDF5, an open and efficient file format to simplify exchange and long term accessibility of data from single-molecule fluorescence experiments based on photon-counting detectors such as single-photon avalanche diode (SPAD), photomultiplier tube (PMT) or arrays of such detectors. The format is based on HDF5, a widely used platformand language-independent hierarchical file for...
متن کاملSupporting XML Based High-Level Abstractions on HDF5 Datasets: A Case Study in Automatic Data Virtualization
Recently, we have been focusing on the notion of automatic data virtualization. The goal is to enable automatic creation of efficient data services to support a high-level or virtual view of the data. The application developers express the processing assuming this virtual view, whereas the data is stored in a low-level format. The compiler uses the information about the low-level layout and the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Journal of synchrotron radiation
دوره 21 Pt 6 شماره
صفحات -
تاریخ انتشار 2014